Image Super-Resolution Based on Generative Adversarial Networks: A Brief Review

Single image super resolution (SISR) is an important research content in the field of computer vision and image processing. With the rapid development of deep neural networks, different image super-resolution models have emerged. Compared to some traditional SISR methods, deep learning-based methods can complete the superresolution tasks through a single image. In addition, compared with the SISR methods using traditional convolutional neural networks, SISR based on generative adversarial networks (GAN) has achieved the most advanced visual performance. In this review, we first explore the challenges faced by SISR and introduce some common datasets and evaluation metrics. Then, we review the improved network structures and loss functions of GAN-based perceptual SISR. Subsequently, the advantages and disadvantages of different networks are analyzed by multiple comparative experiments. Finally, we summarize the paper and look forward to the future development trends of GAN-based perceptual SISR.     

Multi-Purpose Forensics of Image Manipulations Using Residual- Based Feature

The multi-purpose forensics is an important tool for forge image detection. In this paper, we propose a universal feature set for the multi-purpose forensics which is capable of simultaneously identifying several typical image manipulations, including spatial low-pass Gaussian blurring, median filtering, re-sampling, and JPEG compression. To eliminate the influences caused by diverse image contents on the effectiveness and robustness of the feature, a residual group which contains several highpass filtered residuals is introduced. The partial correlation coefficient is exploited from the residual group to purely measure neighborhood correlations in a linear way. Besides that, we also combine autoregressive coefficient and transition probability to form the proposed composite feature which is used to measure how manipulations change the neighborhood relationships in both linear and non-linear way. After a series of dimension reductions, the proposed feature set can accelerate the training and testing for the multipurpose forensics. The proposed feature set is then fed into a multi-classifier to train a multi-purpose detector. Experimental results show that the proposed detector can identify several typical image manipulations, and is superior to the complicated deep CNN-based methods in terms of detection accuracy and time efficiency for JPEG compressed image with low resolution.     

采用轮廓特征匹配的红外-可见光视频自动配准

为了精确地配准近平面场景下的红外-可见光视频序列,本文提出了一种基于轮廓特征匹配的自动配准方法,通过迭代匹配目标轮廓特征来解决异源图像中配准特征的提取和匹配难题。首先,采用运动目标检测技术获取目标轮廓,并由曲率尺度空间(CSS)角点检测算法提取轮廓特征点。此后,建立全局形状上下文描述子和局部边缘方向直方图描述子描述特征,从而实现可靠的特征匹配。来自不同时刻的匹配点对被保存在一个基于高斯距离准则的特征匹配库中。最后,为了克服近平面场景中目标深度变化的影响,本文结合前景样本随机抽样策略计算配准矩阵的损失函数,完成对全局配准矩阵的更新。在LITIV数据库上对方法进行实验验证,结果表明本文方法的配准精度优于当前先进的对比方法,在9个测试视频上的平均重叠率误差仅为0.194,与对比方法相比下降了18.5%。基本满足了近平面场景下红外-可见光视频序列配准的精度要求,且具有较高的鲁棒性。     

港里矿软破围岩采矿的分析与研究

港里矿围岩软弱破碎，随开采深度延伸，地压显现越来越剧烈，严重影响港里矿正常回采。为研究港里矿软破围岩采矿，分析了影响采矿正常进行的因素和机理，调整采矿的顺序，使港里矿软破围岩采矿的困难得到根本扭转，保证了采矿生产的正常进行，选择围岩稳固及充分卸压部位布置斜坡道和联巷、优先回采围岩破碎的高应力区是地压管理的关键问题。     

正弦波纹挡板式沉降器内流动特性

采用VOF模型对正弦波纹式入口挡板的重力非均相沉降器内流场进行数值模拟研究。对比了正弦波纹挡板与平挡板的平均流场分布情况，分析了沉降器的轴向流速均一程度（λ₁）随时间演化特性，探究了λ₁和面积加权平均湍流强度（I_a）在沉降器内空间分布特性；引入流场均稳指标USC，研究了冲击间距（L_b/D）对USC的影响。结果表明：正弦波纹挡板作为入口构件可以有效降低返混。在0.84＜L_b/D＜2.17范围内，正弦波纹板沉降器内流场的均一程度整体高于平面挡板；随着L_b/D减小，平挡板沉降器内流场的λ₁基本不变，但正弦波纹挡板沉降器内流场的λ₁降低，且对I_a的影响不明显。对比平挡板，正弦波纹挡板可以有效降低轴向速度的梯度，使返混区面积减小，流场稳定性提高。随着L_b/D增加，USC值呈现多峰值趋势，L_b/D=2.17时正弦波纹板沉降器的USC取得极大值为14.68，较平挡板提高了93.67%。     

基于深度语义分割的多源遥感图像海面溢油监测

针对遥感图像海面溢油区域通常受到斑噪声以及强度不均等因素的影响,从而导致溢油区域监测效果较差的问题,本文引入了深度语义分割的方法,将深度卷积神经网络与全连接条件随机场相结合,形成端对端连接。以Resnet结构为基础,首先通过深度卷积神经网络对多源遥感图像粗分割并作为输入,然后经过改进的全连接条件随机场,利用高斯成对势和平均场近似定理,建立条件随机场形成递归神经网络作为输出。通过多源遥感图像对海面溢油区域进行监测,并利用可见光图像估计溢油区域面积。实验在所建立的多源遥感图像数据集上与其它先进模型进行对比,结果表明本文方法提高了溢油区域的分割精度以及精细细节程度,平均交并比为82.1%,监测效果具有明显地改善。     

Coupling in situ experiments and modeling – Opportunities for data fusion,machine learning,and discovery of emergent behavior

This paper reviews recent studies, that not only includes both experiments and modeling components, but celebrates a close coupling between these techniques, in order to provide insights into the plasticity and failure of polycrystalline metals. Examples are provided of studies across multiple-scales, including, but not limited to, density functional theory combined with atom probe tomography, molecular dynamics combined with in situ transmission electron miscopy, discrete dislocation dynamics combined with nanopillars experiments, crystal plasticity combined with digital image correlation, and crystal plasticity combined with in situ high energy X-ray diffraction. The close synergy between in situ experiments and modeling provides new opportunities for model calibration, verification, and validation, by providing direct means of comparison, thus removing aspects of epistemic uncertainty in the approach. Further, data fusion between in situ experimental and model-based data, along with data driven approaches, provides a paradigm shift for determining the emergent behavior of deformation and failure, which is the foundation that underpins the mechanical behavior of polycrystalline materials.     

Image analysis applications on assessing static stability and flowability of self-consolidating concrete

A digital image processing (DIP) method associated with a MATLAB algorithm is used to evaluate cross sectional images of self-consolidating concrete (SCC). Two new parameters, such as inter-particle spacing of coarse aggregate and average mortar-to-coarse aggregate ratio, defined as average mortar thickness index (MTI), were proposed to quantitatively evaluate the static stability of SCC. Statistical models were developed to predict flowability of SCC mixtures. Test results revealed that the proposed DIP method and MATLAB algorithm can be successfully used to derive inter-particle spacing and MTI and quantitatively evaluate the static stability on hardened SCC samples. A probability density of 60% from histogram analysis appears to be a reasonable threshold for indicating a uniformly distributed SCC mixture. For a given mortar yield stress, a critical mortar viscosity of 1.30 Pa s tends to significantly affect the trend of slump flow changing with MTI. The investigated relationship between parameters measured from DIP method and existing theoretical frames is well correlated. The outcome of this study can be of practical value for providing an efficient and useful tool in designing mixture proportions of SCC.     

Kernel-based fourth-order diffusion for image noise removal

The fourth-order partial differential equations have good performance on noise smoothing and edge preservation without creating blocky effects on smooth regions. However, for low signal-to-noise ratio images, the discrimination between edges and noise is a challenging problem. A novel kernel-based fourth-order diffusion is proposed in this paper. It introduces a kernelized gradient operator in the fourth-order diffusion process, which leads to more effective noise removal capability. Experiment results show that this method outperforms several previous anisotropic diffusion methods for noise removal and edge preservation.     

Assessment of local strain field in adhesive layer of an unsymmetrically repaired CFRP panel using digital image correlation

The present study focuses on experimental investigation of through the thickness displacement and strain field in thin adhesive layer in single sided (unsymmetrical) patch repaired CFRP (carbon fiber reinforced polymer) panel under tensile load. Digital image correlation (DIC) technique is employed to acquire the displacement and strain (longitudinal, peel and shear) field. Experimental determination of shear transfer length based on shear strain field obtained from DIC is introduced to estimate the optimum overlap length which is an essential parameter in patch design for the repair of CFRP structures. Further, DIC experiment with magnified optics is performed to get an insight into complex and localized strain field over thin adhesive layer especially at critical zones leading to damage initiation. The failure mechanism, load displacement behavior, damage initiation and propagation are closely monitored using DIC. The influence of patch edge tapering on strain distribution in adhesive layer is also investigated. The DIC successfully captures the global and localized strain field at critical zones over thin adhesive layer and further helps in monitoring the damage based on strain anomalies. Strains are found to have maximum magnitude at the patch overlap edge and the shear strain level in adhesive layer is higher than the peel strain. Normal tapering increases the peel strain and has negligible influence on shear strain level in adhesive layer. The recommended overlap length is found to be consistent with the recommendation in the literature. Whole field strain pattern and the overlap length obtained from experiment are further compared with the finite element analysis results and they appear to be in good coherence.